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ABSTRACT 



Background: Studies show that a large proportion of healthcare offered may be inap- 
propriate or unnecessary. Magnetic resonance imaging (MRI) is a new and expensive di- 
agnostic technology which has been increasingly used all over the world. Moreover, this 
trend has been more rapidly increasing in Iran. Low back pain is a common disorder all 
over the world and MRI technique is one of the several ways to assess its cause. 
Objectives: The present study aims to develop scenarios for lumbar spine MRI. 
Materials and Methods: In the present study, the RAND Appropriateness Method (RAM) 
was used in order to reach consensus regarding developing scenarios for lumbar spine 
MRI. We generated scenarios from valid clinical guidelines as well as the experts' opin- 
ion. The panel members included nine specialists from various medical specialties that 
had scored scenarios in two rounds, the first of which was without interaction, while the 
second one was with interaction. 

Results: We extracted 97 scenarios for the lumbar spine MRI in the scenario extracting 
phase of the study and the panel members added 18 scenarios. After implementation of two 
rounds, the scenarios were categorized into three ranges. Sixty seven (58%) of the scenarios 
were considered as appropriate, 45 (39%) as uncertain, and three (2.6%) as inappropriate. 
Conclusions: RAM is useful for identifying stakeholder views in settings with limited re- 
sources. Since RAM has precise instructions for consensus developing, a large number of 
scenarios were considered as uncertain. Therefore, more research has to be conducted 
on the issue. 

Copyright © 2012, Tehran University of Medical Sciences and Iranian 
Society of Radiology. Published by Kowsar Corp. All rights reserved. 



> Implication forhealth policy/practice/research/medical education: 

This method could be used for guideline preparation and identifying the appropriateness of provided care and services; therefore, 
it may decrease costs and promote the quality of care. 
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1. Background 

Healthcare systems face significant and rapid ciianges 
in response to changes in population needs and increas- 
ing costs (1, 2 ). Studies show that a large proportion of the 
healthcare offered is inappropriate or unnecessary, rang- 
ing from 15 to 30 percent in many countries and as much 
as 40 percent in some private clinics (3, 4). The quality of 
and access to healthcare are not related to high expendi- 
tures in the health system (5). Medical imaging costs have 
had an incremental trend worldwide which might be 
due to overuse. In fact, among all medical imaging tech- 
nologies, magnetic resonance imaging (MRI) usage has 
noticeably had a more incremental trend (6-10). In case 
physicians order inappropriately demanded medical im- 
aging procedures, it may result in serious problems in 
terms of both healthcare economy and quality (11). More- 
over, medical imaging overuse might be unable to im- 
prove the patients' health status. As studies have shown, 
20% - 50% of high-tech imaging procedures have been un- 
necessary. (12-15). Various methods have been developed 
in order to measure the appropriateness of health care 
and to develop valid criteria for the physicians (1, 2,16, 17). 
Financial and human resources are needed in order to de- 
velop the clinical guidelines and these resources may not 
be available for low and middle income countries (18). 
Due to these limitations, we aimed to identify the criteria 
for using available valid guidelines. 

2. Objectives 

Since low back pain (LBP) is one of the most prevalent 
disorders (19, 20) and there is little consensus among the 
specialists about appropriate LBP procedures (21, 22), we 
aimed to identify the appropriate criteria for utilization 
of MRI in LBP patients based on the viewpoints of the ex- 
perts in the country. The result of this study may be use- 
ful for policymakers as well as clinicians in Iran and in 
other low and middle income countries. 

3. Materials and Methods 

RAND Appropriateness Method (RAM) was selected for 
the present study since it allows the development of the 
appropriateness criteria based on the available evidence 
which is supplemented by the expert panels' opinion. 
This method was designed in the 1980s by the RAND in- 
stitute and the University of California in Los Angeles 
(UCLA) and has been used in many studies in North Amer- 
ica and Europe. RAM involves generating clinical scenar- 
ios or criteria. RAM has been used in many studies (2, 23) 
especially for development of the appropriateness crite- 
ria in surgical care as well as investigative procedures (2, 
24-26). The present study was conducted in Shiraz in 2011. 
Besides, followed is a modified version of RAM which is 
explained in the next section. 



3.1. Generating Scenarios 

We started the study by searching for available evi- 
dence. In the process of the literature review, we focused 
on clinical practice guidelines and evidence reviews. In 
this waylO relevant documents were identified (27-35). 
Then, we reviewed and verified the identified documents 
and selected four guidelines and evidence reviews which 
provided a relatively comprehensive coverage of the is- 
sues related to MRI for LBP (34, 35). Two panel members 
as well as two authors used the Persian translation of the 
AGREE (Appraisal of Guidelines for Research and Evalua- 
tion) tool (36) in order to assess the guidelines and finally 
selected two of them from which the indications and 
the scenarios were extracted. Each indication was divid- 
ed into several scenarios and each scenario included a 
few words which described the patients' signs. First, we 
identified the major specialists who were involved in the 
prescription of MRI for low back pain, we found that six 
majors were involved in this issue. Then, nine specialists 
were invited to participate in the panel. 

3.2. Panel Members 

The panel consisted of nine specialists: two neurosur- 
geons, two orthopedic surgeons, two radiologists, one 
neurologist, one rheumatologist and one physiatrist, all 
of whom were faculty members and worked in educa- 
tional hospitals. Before the process of consensus making, 
we talked to all the panelists and described the objectives 
of the study as well as the process of consensus making. If 
they agreed, we invited them to participate in the study. 

3.3. Consensus Making 

The process of consensus making among the specialists 
was implemented in two rounds: without interaction 
and with interaction. In the first round, we sent the first 
form (including the list of scenarios, summaries of the 
clinical guidelines and the scoring system) to each expert 
panelist. We asked them to select the best score for each 
scenario based on their professional judgment and sum- 
mary of evidence. The scores ranged from one (absolutely 
inappropriate) to nine (absolutely appropriate). Then, 
they sent the scored scenarios back to us. We entered all 
the specialists' scores to the second form and prepared 
it for the second round of consensus development. The 
second forms provided an opportunity for each panelist 
to be informed about the other panelists' scores anony- 
mously. In the second round, the members were invited 
to a meeting. In the meeting, we gave the second form to 
all the panel members. One author (MHB) was selected as 
the panel leader. He read each scenario, asked the panel- 
ists about each scenario and if necessary, changed their 
first round scores. The meeting lasted for six hours. Then, 
the new indications presented by the specialists were col- 
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lected and discussed. In the meeting, it was emphasized 
that the panehsts should score the scenarios indepen- 
dently while considering the panel discussions. 

3.4. Statistical Analysis 

Median scores were used to judge the appropriateness 
of the scenarios. The scores were categorized into three 
groups: appropriate (score = 7-9), uncertain (score = 4-6), 
and inappropriate (score = 1-3). Of course, in order to reach 
agreement, another condition had to be met: if mini- 
mum and maximum scores are ignored, all the other 
scores must fall in the same scoring group. 

4. Results 

We extracted 97 scenarios for the lumbar spine MRI in 
the scenario extracting phase of the study. We divided the 
scenarios into sixteen indications, as used in the selected 
guidelines (34, 35), in order to make the assessment eas- 
ier for the panel members (23). Totally, over eighty nine 
percent of the scenarios were considered as appropriate, 
but the agreement was reached on 72 (74%) of them. Only 
three scenarios were considered inappropriate at the first 
round. According to the results, the second and the fifth 
indications had the highest extracted scenarios. Compar- 
ing the indications, the tenth indication contained the 
highest number of appropriate scenarios with agree- 
ment {Table I). In the second round of consensus mak- 
ing, the panel members added 18 indications to the first 
list, all of which were appropriate, but the agreement on 
them was zero. After discussion during the second panel, 
four indications were ignored from the list and the con- 
sensus process was done on 30 indications. The rate of 
appropriateness and agreement of scenarios in the sec- 
ond round is presented in Table 2. It is seen that among 
the 111 scenarios of lumbar spine MRI, 103 were consid- 
ered as appropriate, amongst which 68 (66%) scenarios 
were agreed upon. We prepared a table including some 
examples of appropriateness of the scenarios which are 
shown in {Table 3). 

5. Discussion 

To the best of our knowledge, this is the first study that 
has used the RAND Appropriateness Method for lumbar 
spine MRI indications. In our study, lumbar spine MRI was 
considered in 67 (58%) of the scenarios as appropriate, 45 
(39%) as uncertain, and three (2.6%) as inappropriate. After 
two rounds of consensus development, there were still 67 
scenarios in which no agreement was reached or the re- 
sults remained equivocal. This may demonstrate the am- 
biguous nature of decision making on whether the MRI 
is indicated for a patient. It may partly explain why it has 
been so difficult to curb or slow the growth in unneces- 
sary services provided such as the lumbar spine MRI rate 
around the world (3, 4, 12-15). Our results will help deci- 
sion makers in identifying appropriate procedures and 



focusing their efforts on decreasing unnecessary care. In 
evidence-based medicine, the question arises that what 
should be done if there is insufficient evidence for a pro- 
cedure routinely performed in practice (37). In developed 
countries, evidence-based clinical guidelines have been 
helpful, but in middle and low income countries there 
are serious limitations in preparing these materials (38, 
39). Moreover, evidence-based clinical guidelines often 
lack flexibility and may not provide enough details for 
clinicians when making decisions about individual pa- 
tients (38, 40). Formal consensus development (includ- 
ing RAM) provides a timely and efficient solution when 
evidence is insufficient (40). In our study, we overcame 
this limitation by developing scenarios representative 
of the patients seen by clinicians in practice. It should be 
noted that consensus methods are most widely used in 
procedures that there is no agreement on. Moreover, no 
studies were found on using these methods in the lum- 
bar spine MRI. Rashidian (40) performed a review of the 
evidence in order to identify the indicators of the lumbar 
spine MRI. General similarities may be observed between 
the results of the study carried out by Roudsari and the 
present study. However, our method was more effective 
since each of the indicators was divided into detailed and 
accurate scenarios. Accurate and detailed scenarios can 
be useful for physicians in practice. In some studies, ques- 
tions remain about the validity of recommendations 
based on such methods (39). Tan et a/.(41) have described 
the complexities and limitations of using RAM. Many of 
their criticisms equally apply to other consensus devel- 
opment methods. It should be noted that such methods 
are useful when there are disagreements or variation 
in practice and reliable evidence is limited. In these cir- 
cumstances, formal consensus methods are valuable and 
their use is inevitable. We spent time on familiarizing the 
panel members with the method and attracting their val- 
ued cooperation. Membership of the panel involves open 
discussions of personal views and practices and that cer- 
tain practices might not be supported by evidence or by 
other panel members. As an advantage of our study, we 
used the AGREE tool for selection of the evidence sources. 
This provided a chance for the panel to reach a shared un- 
derstanding of the evidence before embarking towards 
consensus building. We also selected the members from 
different backgrounds and settings to improve compre- 
hensiveness of the views (42, 43). RAM usually results in a 
long list of scenarios. To ease the use of its results, it may 
be possible to develop user-friendly software, or to cate- 
gorize the scenarios into indications and packages in the 
format of clinical guidelines. We demonstrated that the 
RAM is useful for development of scenarios for appropri- 
ateness of lumbar spine MRI in a developing country. The 
method should be used more widely in such settings in 
other areas of healthcare where controversies exist or the 
practice varies. It also has the added value of developing a 
level of ownership by the providers if they see their peers 
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and relevant stakeholders are adequately represented in 
the process. 

The findings of this study can be used for developing na- 
tional guidelines, conducting research to assess whether 
the criteria are followed in practice and whether their ap- 
plication can curb the growing rate of unnecessary care 
in all countries. In Iran, a limited amount of resources are 
allocated to the health sector. Since MRI is an expensive 
method of medical diagnosis, doctors have to prescribe it 
after the easier ways of diagnosis are not useful. 
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